Change of active user of a stylus pen with a multi user-interactive display

ABSTRACT

In a multi-user, collaborative environment, an operating system state change can occur by passing a stylus pen from one user to another. Upon detecting a change of the active user, a state machine transition can result in a change in a user experience. In one example, a change in the user experience includes a change in user interface (UI) functionality. Some examples include changing color of the digital ink being displayed, changing a handwriting pattern, and automatically switching a view displayed on the user interface. The switched view can be switching from a single-user model to a multi-user model. In another example, a state machine transition can result in establishing connections between devices (e.g., phones or laptops) associated with the users that used the pen.

BACKGROUND

A stylus or a stylus pen is often used as an input device to a digitizerassociated with a computer screen, mobile device, graphics tablet, andother devices. With touchscreen devices, a user places a stylus on thesurface of the screen to write, draw, or make selections by tapping thestylus on the screen. As such, the stylus is used as a pointing devicein addition to a mouse, track pad, or finger.

Stylus pens can be used in a collaborative environment, such as on amulti-user display, also called an interactive whiteboard. Aninteractive whiteboard is a large digital display that can receivemultiple users' input simultaneously. For example, users can use astylus pen, touch, or a combination of pen and touch on the digitaldisplay to have more natural interactions with data, which are notpossible on a traditional whiteboard. Additionally, in traditionalwhiteboards, it is common to pass a marker from one user to another aseach person takes a turn presenting and writing on the white board usingthe marker. Such interactions between users have not been integratedinto the collaborative environment of an interactive whiteboard.

SUMMARY

This Summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. This Summary is not intended to identify key features oressential features of the claimed subject matter, nor is it intended tobe used to limit the scope of the claimed subject matter.

In one embodiment, a method is disclosed for interacting with amulti-user display. A detection can be made that a first user of astylus pen has handed the stylus pen to a second user. In response tothe pen handoff, a user experience adaptation is made by changingfunctionality associated with the multi-user display. For example, UserInterface (UI) behavior can be modified based on the handoff. In oneexample, the UI can go from a single-user mode to a shared mode (i.e., amulti-user mode). In the multi-user mode, a new application window canbe opened wherein shared content between the users is displayed. Anotherexample is that the UI interaction model can be modified, such as howapplications are launched, how windowing is performed, etc. One example,is that upon a pen handoff, any subsequent keyboard entries are directedto the shared application windows, rather than the previous userinterface context.

In other embodiments, relationships between the users can beautomatically established due to the pen handoff. For example,communication channels can be automatically established between personaldevices of the users, such as between laptops or phones of the users.Relationships can also be established automatically on social media byconnecting the users involved in the pen handoff.

In still other embodiments, the pen handoff can impact how digitalagents are utilized during a meeting. For example, ArtificialIntelligence (AI) agents can treat an active user of the stylus pendifferently than other users in a meeting environment. A simple exampleis that the active user can be interpreted as a leader of theconversation and agenda items, events to calendar, etc. can be givenpriority for the active user over the participants in a meeting.

The foregoing and other objects, features, and advantages of theinvention will become more apparent from the following detaileddescription, which proceeds with reference to the accompanying figures.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram of a collaborative environment in which users areinteracting with a multi-user display.

FIG. 2 is a diagram wherein multiple users interact with a multi-userdisplay with a pen handoff resulting in a new application windowopening.

FIG. 3 is an example of a digitizer circuit used in conjunction with themulti-user display to receive touch and stylus signals.

FIG. 4 is an example hardware circuit used in a stylus pen.

FIG. 5 is another example showing further details of a hardware circuitused in a stylus pen with multiple hardware components to assist inidentification of an active user.

FIG. 6 is an example environment showing components of the multi-userdisplay in conjunction with other services coupled to the multi-userdisplay.

FIG. 7 is an example of opening an application window with sharedcontent in response to handing a stylus pen to a different user.

FIG. 8 is an example showing how third-party social media websites canbe used in conjunction with a pen handoff.

FIG. 9 is an example showing how the user interface interaction modelcan be modified in response to a pen handoff.

FIG. 10 is a flow chart according to one embodiment for adaptingfunctionality of a multi-user display in response to a pen handoff.

FIG. 11 is a flow chart according to another embodiment for adaptingfunctionality of a multi-user display in response to a pen handoff.

FIG. 12 is an example computing system which can be used to implementany of the embodiments described herein.

DETAILED DESCRIPTION Overview

In a multi-user, collaborative environment, an operating system statechange can occur simply by passing a stylus pen from one user toanother. Upon detecting a change of the active user, a state machinetransition can result in a change in a user experience. In one example,a change in the user experience includes a change in user interface (UI)functionality. Some examples include changing color of the digital inkbeing displayed, changing a handwriting pattern to make a user'shandwriting more legible (e.g., consistent, or in a legible font),automatically switch a view displayed on the user interface, etc. Theswitched view can be switching from a single-user model to a multi-usermodel. In another example, a state machine transition can result inestablishing connections between devices (e.g., phones or laptops)associated with the users that used the pen. For example, when a penhandoff occurs, it can impact which devices are shared with the mainoperating system of the multi-user display. Additionally, a pen handoffcan result in a social network connection between users. In still afurther example, a person holding the stylus pen is considered theleader of the conversation and digital agents (Artificial Intelligence(AI) agents) can provide the leader with an elevated status level. Forexample, the leader can direct action items to be taken in meetingnotes, whereas others within a meeting have a different status level.Additionally, or alternatively, the AI can establish different roles forthe person holding the stylus pen, past holders of the stylus pen, andother participants that have not used the stylus pen. These and otherexamples are further illustrated below in relation to the figures.

FIG. 1 shows an example interactive display environment 100. In thiscase, the environment includes an interactive multi-user digital display110. The interactive multi-user display is one wherein multiple inputdevices can be used simultaneously by different users. For example, insuch a display there can be two or more application windows in-focussimultaneously (accepting user input). Additionally, the multi-userdisplay can have different log-ins for the different users working onthe multi-user display simultaneously. One or more users (shown as UserA and User B) can participate in an interactive experience using themulti-user display 110. The multi-user display can include a multi-userinteractive display screen 116, digitizer hardware (not shown, butdescribed in FIG. 3) and processing hardware (not shown, but describedin FIGS. 4 and 5) and multiple sensors, such as sensor 120. The displayscreen can be any of a variety of screens, including, but not limited tolight emitting diode (LED) screens, liquid crystal screens,electroluminescent screens, plasma screens, and/or other developing oryet to be developed display and screen types.

The sensors 120 can include one or more cameras for capturing a regionin front of the multi-user display. The cameras can be configured forvisible light, infrared, and/or other frequencies. The cameras mayoperate in conjunction with an infrared pattern projector that assiststhe cameras to distinguish objects. Other camera configurations can usetime of flight or other techniques to enhance information captured bythe cameras about the user(s) and/or the environment. In oneimplementation, the sets of sensors can be Kinect® brand sensingtechnology offered by Microsoft.RTM® Corp. Additionally, the sensors 120can include audio hardware for capturing voices interacting with thedisplay 110. Other types of sensors can be used, such as pressuresensors integrated into the screen 116. Any number of desired sensorscan be used for detecting user engagement with the multi-user display,including assisting in detecting when a pen handoff occurs and assistingto identify which user is the active user. Differing levels of detectioncan be used to identify a user. For example, camera and voiceidentification can be considered a low-level identification, whereas afingerprint recognition by the stylus pen can be a high-levelidentification of a user. Once a user has been detected, the sets ofsensors 120 can track the user's position relative to the screen 116 andmovements can be tracked to detect a stylus pen handoff or to determineif the user is attempting a user command, such as writing on the screen,making a control gesture, etc.

The environment 100 is intended to represent a meeting environment. Insuch an environment, each user can bring a personal device 130, 132 tothe meeting. In this example, personal devices 130, 132 are laptopcomputers, but other mobile devices are also typically brought tomeetings, such as a mobile phone 134. These personal devices 130, 132,134 can be used to enter commands or content into the display 110 or toassist in identifying the user. Identification of a particular user canbe accomplished by identification signals being sent, such as byBluetooth or other communication protocols, from the user's personaldevice. Such signals can be received by the sensors 120, the displayitself 110, or other devices within the meeting room, such as an AIfront end 150. The AI front end can be used in conjunction with abackend server computer (not shown) to perform cloud-basedfunctionality, such as taking meeting notes, adding calendar events,etc. The AI front end is described further below in FIG. 6

Users can interact with the multi-user display simultaneously and usingmultiple input devices. For example, User A is shown using a stylus pen160, whereas User B is entering data using touch commands, as shown at162. As described further below, the stylus pen 160 and sensors 120, 150can include numerous hardware devices for capturing biometric propertiesassociated with the user, including, but not limited to, fingerprints(using fingerprint sensors in the stylus), facial imaging (usingcameras, such as are included in sensors 120), voice recognition (usingmicrophones, such as are included in AI voice recognition 150), etc.Thus, two or more different sensors can collaborate to provideidentification information of the user. Metric (i.e., measurable)properties can also be used to identify the user including grip (fingerpositioning sensors in the stylus), pressure (pressure sensors in thestylus), angle of the stylus during use (gyroscope in the stylus), speedof writing (timer in the stylus) and changes in writing speed(accelerometer in the stylus). Typically, the stylus pen 160communicates with a digitizer below the screen 116 to transmit theidentification information to an operating system running in themulti-user display. Other information can also be communicated to theoperating system, such as camera data. The camera data can be used toassist in identification, angle of the stylus during use, and othermetrics described above.

When a touch command is detected as shown at 162, fingerprint (and/orother biometric) analysis can be used to identify the user performingthe command. Fingerprint analysis can also identify which individualfinger of the user is touching the screen and the orientation of thefinger. This information can be used to analyze if two userssimultaneously touch a region of the board and the finger orientationcan indicate which finger belongs to which user. Detection of a usermeans that the presence of a user is determined, with any varying degreeof ability to identify the user. Thus, detection can include justknowing a relative position of a person, without knowing the actualidentity of the person, or knowing the position and the identity of theperson so that personal information can be obtained from a database.

When a stylus pen 160 is handed off between user A and user B, itindicates a relationship between the users, whether it be workcolleagues or friends. Such an identification of a relationship can beleveraged by using any of the above-identified sensors that are in theenvironment 100, including the sensors 120 and the stylus pen 160. Forexample, an operating system can detect that user A's fingerprint waspresent during a first time period and user B's fingerprint was presentduring a second time period. Thus, when different users are detectedholding the stylus pen 160, it indicates that a pen handoff occurred. Atthat point, the operating system can change state so as to adapt theuser experience for either or both the user receiving the pen and theuser delivering the pen. The adapted user experience can includeestablishing a communication channel between personal devices 130, 132or 130, 134. Such a communication channel can be established throughBluetooth or other wireless communication channel, or through a networkcommunication channel. Adapting the user experience can also includechanging the UI in some way, such as how new applications are launched,opening new application windows, the position of where applicationwindows open, etc. Additionally, the AI voice recognition 150 can adaptits behavior by giving priority to the active user of the stylus pen.Thus, information from the meeting can be treated as if the active useris the leader of the meeting. The leader can be given priority onsetting agenda items, calendaring meetings, inviting other team members,etc. Other behavioral adaptations can include attributing notes tousers, changing language models based on who is talking, etc.

FIG. 2 shows a multi-user display 210 wherein a user A has an openapplication window 220 and is inputting data into the application usinga stylus pen 230. As indicated at 240, user A hands-off the stylus pen230 to user B. The multi-user display 210 detects that user B is now theactive user of the stylus pen 230. As a result, a new application window250 is automatically opened and user content associated with user B isautomatically displayed. Thus, as a result of changing the active userof the stylus pen 230, the multi-user display 210 adapts functionalityassociated with the user interface of the multi-user display 210. Otherfunctionality associated with user B can include automatically changinga digital ink color that is displayed when user B writes data into theapplication window 250. Other digital ink properties can also be changedincluding, but not limited to, a width of the ink stroke, a brush style(e.g., calligraphy, blotting with pressure, pencil mode vs. pen mode,fat marker vs. ball point pen, etc.). Other example changes infunctionality can be controlled through button action mappings. Suchadaptations in functionality can be stored in a user profile ascustomization options that occur upon a pen handoff. Identification ofuser B can also result in the multi-user display obtaining profile dataassociated with user B such as handwriting patterns, knowing whetheruser B is left-handed or right-handed, etc. Knowing the handwritingpatterns of a user allows the system to display the user's handwritingin a more consistent manner. Thus, if a user makes a letter more sloppythan usual, the multi-user display 210 can change the letter so that itappears like the same letter stored within the user's profile.Understanding whether a user is left-handed or right-handed allows thesystem to better interpret the handwritten data entered into theapplication window. For example detection of a user's palm is useful soas to ignore where the palm touches the multi-user display screen.

Example Digitizer

FIG. 3 shows a digitizer circuit that can be used to detect stylus pensignals associated with the multi-user display. Typically, the digitizercircuit is positioned directly behind the display screen, which includesthe outer glass. The digitizer converts analog signals into digitalsignals. For example, user interface actions, such as presses or swipeson a touch screen are converted to digital signals to allow a user towrite, erase, or move content displayed on the touch screen. The styluspen typically includes a first end, called a stylus tip, for writingcontent and a second end for performing a digital erasure of thecontent. As further described below, the stylus pen tip and/or eraserend can transmit signals to the multi-user display so as to operate as auser input device. When the stylus pen is detected, it can switch to oneof a plurality of candidate protocols, without interaction from theuser, so as to communicate with the digitizer. The stylus pen can thendynamically set a protocol used to communicate with the digitizer thatmatches the protocol expected by the digitizer. Setting the protocol canimpact the waveforms generated by the stylus pen. For example, transmitand receive time slots can conform to the selected protocol, as well asthe transmit modulation. Finally, the stylus pen can enable componentsthat are supported by the selected protocol or the specific digitizer.

FIG. 3 shows a digitizer circuit 300. The digitizer circuit 300 includesa plurality of electrodes including column electrodes 310 and rowelectrodes 312. The columns are positioned above the rows with a gapthere between so as to form a capacitance between each column and row.The capacitance between the columns and rows of electrodes changes whena finger or stylus comes in contact with a surface of the digitizer. Aplurality of receiver circuits 320 can be used to sense the changingcapacitance, which indicates a location of the user's finger or thestylus on the digitizer. The digitizer 300 further includes a pluralityof transmitters 330, one per row of electrodes 312, for transmittingtouch signals on the electrodes in a scanned pattern. The transmittedtouch signals are received on the column receivers 320 so as to detectany change in capacitance. The column electrodes 310 can also receivestylus pen signals when the stylus pen is brought in contact with thedigitizer surface. A location of the stylus pen can be determined basedon which column electrode 310 is receiving the strongest stylus signal.

Example Stylus Pen Circuits

FIG. 4 shows a first embodiment of stylus pen circuitry that can be usedto analyze a digitizer's touch signals. The stylus circuitry 400includes a receiver circuit 410 configured to receive wireless touchsignals in analog form from a digitizer (FIG. 3), which is positionednear the stylus pen. An Analog-to-Digital Converter (ADC) 420 is coupledto an output of the receiver in order to convert the analog touchsignals to digital for processing by the stylus circuitry 400. Theoutput of the ADC is coupled to the signal processing circuitry 430 thatincludes a processor 440 (which can be a general processor, an ASIC, ora microcontroller) and any desired supplemental signal processingcircuitry 450. The processor 440 is coupled to the supplemental signalprocessing circuitry 450 such that the processor 440 can receive avariety of different data related to the characteristics of the touchsignals received from the digitizer. The supplemental signal processing450 can also be directly coupled to the receiver 410 so that thesupplemental signal processing 450 can process the amplified signaldirectly without needing the ADC. As further described below, thecharacteristics received from the ADC 420 or the receiver 410 can relateto either time-based or frequency-based characteristics of the touchsignals including rise times of the touch signals, pulse characteristicsof the touch signals, frequency characteristics of the touch signals,etc. The processor 440 can communicate with the digitizer via a wirelesstransmitter 470 using a selected protocol. Generally, the processor 440transmits data (such as stylus-related data) to the digitizer using theprotocol. For example, the stylus-related data can include a serialnumber of the stylus, pressure data, the state of any buttons on thestylus, battery level data, and Inertial Measurement Unit (IMU) data.The IMU can be used to retrieve data about force, angular rate, andmagnetic field surrounding the stylus pen. Additionally, accelerometers,gyroscopes and magnetometers within the IMU can be separately used.Additional information can include information associated withidentifying the user, such as metric or biometric data described furtherbelow in relation to FIG. 5.

FIG. 5 shows further details of the signal processing circuitry 430 fromFIG. 4. The receiver 410 and ADC 420 (from FIG. 4) are repeated forclarity. The receiver 410 receives touch signals from a digitizer aspreviously described. Those touch signals are converted to digital bythe ADC 420. The output of the ADC can be supplied to multiple differenthardware and/or software components used to perform signal processing onthe touch signals. For example, the processor 440 itself can performsome or all of the signal processing that is shown as performed by othercomponents. Other components can be coupled directly to the receiver 410without passing through the ADC. A correlation engine 510 is coupled tothe output of the ADC 420. The correlation engine 510 correlates databetween the detected touch signals and signatures that are stored in thememory 460 of the stylus pen. The correlation engine 510 can perform avariety of correlation-type functions, such as comparing points in thereceived wave form to points in the stored wave form in order to detecta similarity between the wave forms. If the similarity exceeds athreshold level 511, then the correlation engine determines that a matchis found. The threshold level 511 can be based on a constant or can beprogrammed by the user. The correlation function performs apoint-to-point multiplication and adds the result to generate thecorrelation output C. The higher the output of the correlation function,the more likely that the two functions are correlated. If thecorrelation function output exceeds the threshold level 511, then thetouch signal is determined to match the signature in memory.

A Fast Fourier Transform (FFT) engine 512 can be used in addition to thecorrelation engine 510 or as an alternative to the correlation engine.The FFT engine 512 receives the touch signals from the ADC 420 andperforms frequency analysis on the touch signals. In particular, asdescribed further below, different manufacturers can have differentfrequency spectrums associated with their touch signals. For example,some vendors may use different frequencies, implying their respectiveFFTs will have dominant peaks in different locations. In some cases, theFFT engine may also be used to distinguish between digitizers operatingat the same fundamental frequency, if their harmonics have differentamplitudes (e.g., due to drivers with different slew rates). The FFToutput can be passed to the processor 440, which can compare the outputfrom the FFT engine 512 to signature frequency data stored in the memory460. Based on the comparison, an identification of the digitizer can bemade.

An envelope detector 516 can be coupled to the output of the receiver410 to perform envelope analysis on the input touch signals. Theenvelope detector 516 can track peaks in the input touch signals and,depending on a time constant, can either track individual peaks of aseries of pulses or of a general shape of the series of pulses. Theoutput of the envelope detector 516 can be passed to the processor 440for analysis. In particular, the processor can compare various pulsecharacteristics determined by the envelope detector 516 with storedpulse characteristics within the memory 460. If the pulsecharacteristics match, the processor can use the memory 460 to retrievethe digitizer's make and model. Specifically, the data record within thememory 460 can store both the digitizer's make and model with thesignature data associated with the digitizer so that when a signature ismatched, the make and model can be retrieved. Additionally, the samedata record can store information associated with a protocol to use withthe digitizer. The information can be individual parameters orconfiguration settings.

A pulse train characterizer 520 can be coupled to the receiver 410 inparallel with the correlation engine 510, the Fast Fourier Transformengine 512 and the envelope detector 516. The pulse train characterizer520 can include timers and comparators used to measure pulse width,pulse train length, and the pulse train period. Such characteristics ofthe pulses or combinations of pulses that make up the touch signals canbe used as a signature to detect the type of digitizer generating thetouch signals. Other pulse-related characteristics can be used, such asa number of pulses, an amplitude of the pulses, and a length of gapsbetween pulses.

The signal processing circuitry can further include a rise-time startcomparator 530, a rise-time end comparator 532, and a timer 534. Therise-time start comparator 530 and rise-time end comparator 532 arecoupled in parallel to the receiver 410 for receiving the touch signals.As soon as a first pulse of a touch signal is received, the rise-timestart comparator starts the timer 534, such as on a rising edge of thepulse. When the pulse reaches its maximum amplitude, the rise-time endcomparator 532 turns off the timer 534 so that the timer accuratelyreflects a rise time of the pulses associated with the touch signals.The timer output can be coupled to the processor 440 which can thencompare the rise time to stored rise times in the memory 460. As aresult, the rise times represent a signature of the touch signals thatcan be compared to known signatures stored in memory for identifying themanufacturer, model or configuration of the digitizer. Additionally,such timing can be correlated to a user's typical patterns so as toassist in identifying a user.

Using one, multiple or all of these various signal processingcomponents, the processor can identify which digitizer generated thetouch signals that were received on the receiver 410. The processor canthen select a protocol that is suitable for communication with thedetected digitizer and can further enable electrical components 550 onthe stylus pen. The electrical components can be a variety of differentcomponents and/or features that may only be supported by a specificprotocol or manufacturer, such as Bluetooth or other sensors on thestylus. Coupled to the electrical components 550, or incorporatedtherein, are different hardware functions that can be used to identifyan active user of the stylus pen. For example, fingerprint sensors 560can include a pad (not shown) on an external body of the stylus pen. Thefingerprint sensor 560 serves to identify the user of the stylus penwith a high degree of certainty. The fingerprint sensor includes anelectronic device used to capture a digital image of the fingerprintpattern. The captured image, called a live scan, can be digitallyprocessed to generate a biometric template used for pattern matching.Various patterns of known users can be stored in the memory 460.

The accelerometer 570 can be used to detect a user's characteristicswhen the stylus pen starts or stops when writing words. Different userstypically start and stop at different speeds allowing the accelerometerto assist in identifying a user. The pressure sensor(s) 572 detects howmuch force a user exerts while holding the stylus pen. Again, suchpressure sensing can assist in identifying a user. The finger positionsensors 574 can be used to detect how a user holds the stylus pen, suchas a distance between a forefinger and a thumb. Such a characteristiccan be used as an identification factor. Finally, the gyroscope 576 canbe used to determine an angle a user holds the pen, which is also anidentifying characteristic. Using one or more of such identificationcircuits, the stylus pen can determine when a handoff of the stylus penoccurs. Other sensors can be separately used or integrated into thesensors described above, such as capacitive sensors, transducers andultrasound. For example, with ultrasound, both continuous wave andpulsed ultrasonic signals can be used to determine distance or positionof the stylus pen. With capacitive sensors, a user's finger position canbe determined. Moreover, a particular identification of the user can bedetermined. The identification information, or the collected data, canbe passed to the multi-user display via a wireless signal, which canhave access to additional processing power, such as through a network sothat an identification can be made. If the user is identified, profileinformation can be obtained from the network and used in interpretingthe user's handwriting or otherwise performing actions associated withthe user, such as retrieving data for launching the user's applicationsor other personal data.

Example Display System

FIG. 6 illustrates an example display system 600 including a displayscreen 610. The display screen can be any of a variety of screens,including, but not limited to light emitting diode (LED) screens, liquidcrystal screens, electroluminescent screens, plasma screens, and/orother developing or yet to be developed display and screen types.Typically, the display screen 610 is an outer glass piece that userstouch with their fingers or with a stylus pen. Capacitive effects of theuser interaction with the display screen 610 can be captured by adigitizer 620. As described above, the digitizer includes multiple rowsand columns of electrodes that can be used to detect capacitive effectsof a stylus. The digitizer 620 can be used to transform analog signalsto digital signals so as to capture a location of the stylus pen.

A processor 630 can be coupled to the digitizer 620 and executes anoperating system for controlling the display system. The processor canbe a general-purpose central processing unit (CPU), processor in anapplication-specific integrated circuit (ASIC), or any other type ofprocessor. As shown at 632 when there is a change in the active user ofthe display screen 610, the operating system changes state of a statemachine shown in part at 632. The change in state of the operatingsystem results in adapting functionality of the multi-user display. Asdescribed earlier in relation to FIGS. 1 and 5, identification signalscan be transmitted from any of a variety of electrical components(fingerprint sensors, accelerometer, gyroscope, etc.) so as to identifythat an active user of the stylus pen has changed. In the example shownat 632, the operating system can change state due to the pen handofffrom a single-user mode to a multi-user mode. Other changes infunctionality are further described herein in relation to other figures.However, in all cases, adapting functionality means that the operatingsystem state transitions from one state to another in response to thepen handoff. Thus, two states are shown as a minimal example of a muchlarger state machine. The operating system executing on the processor630 can then transmit display data to a rendering engine 640, whichdisplays the display data on the display screen 610.

The operating system executing on the processor 630 can also communicatevia a network 650 to third-party service 660. The network 650 can be anytype and/or form of network and may include any of the following: apoint-to-point network, a broadcast, local area or wide area network, atelecommunications or data communication network, a computer network, anATM (Asynchronous Transfer Mode) network, a SDH (Synchronous DigitalHierarchy) network, a SONET (Synchronous Optical Network) network, awireless network and a wired network. The network can also include awireless link, such as a satellite band or an infrared channel.

The third-party service 660 can be, for example, a social network, suchas a social networking site. If the operating system detects a change ofactive users, the operating system can transmit a request to establish arelationship between the active user of the stylus pen and the previousactive user of the stylus pen. For example, because both users arecommunicating using a same display screen 610 and they are sharing astylus pen, the operating system assumes that the users are colleaguesor friends. In some embodiments, the stylus pen can provide identifiersfor the new active user and the previous active user. The identifierscan be correlated to user-specific data stores 634 of access tokens tothird party services (e.g. OAuth2 tokens to LinkedIn®, Facebook®, etc.).The tokens can be populated in the database based on explicit userauthorization to access a third-party service. The tokens are correlatedto user identifiers. With knowledge of the two identities involved inthe handoff interaction, a detection of a handoff of the stylus penresults in an API request (e.g. HTTP request to a REST API) to thethird-party service on behalf of one of the two users to “connect” theusers using the correlated access token. Connecting the users includesthat content associated with each user's account can be shared with theother user. Third-party services can then track interactions betweenpeople for the purposes of sales, networking, relationship management,etc.

The third-party service can be replaced with an enterprise-based serviceor a local (on system) service. An example local service can be that ashared device pre-caches content of another user while a current user isactive, based on their interaction history. For the enterprise service,an enterprise can intelligently understand how their employees interactwith each other and deduce work performance metrics given someinteraction history.

The operating system can also be coupled through a network, for example,to an AI voice recognition engine 670. The engine 670 can communicatewith a backend AI server 680 to assist in identifying speech patternsand voice commands so as to identify which user in a meeting is speakingand to make intelligent decisions about action items that can beimplemented. The operating system can pass user identifiers to theengine 670 associated with the recent active users of the system. Thebackend AI server 680 can then use the identifiers to determine whichuser is the active user. The determined active user can be given ahigher status when it comes to action items and setting calendaredmeetings.

Switching from Single-User Mode to Multiple-User Mode

FIG. 7 shows a multi-user display 700 wherein two users, user A and userB, previously interacted simultaneously on the multi-user display inapplication windows 710 and 720. At a point in time indicated at 726, astylus pen 728 is handed over from user A to user B. As a result, theoperating system detects that a pen handoff occurred so as to switch theactive user from user A to user B. Such a detection occurs as a resultof the operating system receiving identification signals from the styluspen 728, which indicates user A using the pen during a first period oftime and then the operating system receives identification signalsindicating user B now has control of the stylus pen 728. In response,the operating system can automatically launch a shared application 730at a position within a middle of the multi-user display 700 with sharedcontent included therein, such as content associated with user A andcontent associated with user B. For example, some content fromapplication window 710 and some content from application window 720 aremoved into the shared application window 730. Thus, the operating systemadapts the functionality of the multi-user display by automaticallyswitching a user interface view in response to a change in the activeuser. By changing the user interface view, it is meant that applicationwindows can be opened and moved so as to accommodate the change from asingle-user mode to a multiple-user mode. For example, when the newapplication window 730 opened, the application window 710 could havemoved to the right so as to accommodate the new window 730. Likewise,application window 720 could have moved to the left so as to open a gapbetween application window 720 and 710 sufficient for application window730 to be displayed. Typically, application window 730 will be openedsomewhere between where a user A and user B were previously interfacingwith the multi-user display.

The application window 730 includes shared content. In the illustratedembodiment, the shared content includes content associated with user Aand content associated with user B. Such content can be derived fromopen applications associated with each user or stored content associatedwith each user. Specifically user A and user B are each separatelylogged in to the multi-user display and each user has different accessauthority to stored information. Such stored information can beretrieved by the operating system of the multi-user display andpresented in the shared application window 730. In some respects, themulti-user display can be considered a same display screen runningdifferent virtual computers in which both user A and user B are loggedin. However, when a pen handoff occurs, the system automaticallyswitches to a shared mode wherein both users are logged into a samevirtual computer that is running the shared application window 730.Additionally, prior to the pen handoff 726, multiple application windows710, 720 were in-focus, but the pen handoff switched the view such thatapplication windows 710 and 720 were removed from focus and applicationwindow 730 was placed in-focus. Keyboard entries from either user A oruser B (from personal devices) can then go directly into the sharedcontent window 730. Thus, with user A and user B sharing an applicationcanvas in which multiple applications are simultaneously running andin-focus, a stylus pen 728 handoff triggers a change in view of what isdisplayed in the multi-user display 700. The change of view can resultin a change of rules for user input (both users input into the sharedapplication window), a change of log-in status (both users are loggedinto a virtual computer executing a shared application 730), and achange in look and feel on the user display, as a new application windowautomatically opened. One example of a change of look and feel is thatthe new application 730 can be opened as a full-screen window toaccommodate the shared aspect. Thus, in single-user mode smallerapplication windows can be opened, but in a shared, multi-user mode,larger application windows can be opened, and switching from thesingle-user mode to the multi-user mode can occur automatically bysimply handing the stylus pen to a different user.

Establishing Relationships Between Users as a Result of Pen Handoff

FIG. 8 illustrates establishing a third-party relationship in responseto a pen handoff. Establishing a relationship means that the users areable to, at least, share content electronically, such as throughcommunication channels or using a third-party website. In some contexts,a pen handoff between the user A and user B can result in establishingrelationships between these users outside of the context of themulti-user display 800. Previously it was described, in relation to FIG.1, that a pen handoff can result in establishing a communication channelbetween personal devices of the users. For example, communicationchannels can be established between the users' laptops or smart phones.However, relationships can also be established between the users onthird-party websites. For example a processor 810 associated with themulti-user display 800 can detect the change in active user of thestylus pen and correspondingly retrieve access tokens from database 820associated with third-party services. The processor 810 can thengenerate an API including tokens of user A and user B to a third-partywebsite 830. The API can request establishment of a connection betweenthe user A and user B such that the users share content through thethird-party social media site.

In a particular embodiment, the stylus pen 840 provides identifiers forthe new active user and the previous active user. The identifiers can becorrelated to user-specific data stores 820 of access tokens tothird-party services (e.g. OAuth2 tokens to LinkedIn®, Facebook®, etc.).The tokens can be populated in the database based on explicit userauthorization to access a third-party service. With knowledge of the twoidentities involved in the handoff interaction, a detection of a handoffof the stylus pen results in an API request (e.g. HTTP request to a RESTAPI) to the third-party service on behalf of one of the two users to“connect” the users using the correlated access token. Third-partyservices can then track interactions between people for the purposes ofsales, networking, relationship management, etc.

The third-party service can be replaced with an enterprise-based serviceor a local (on system) service. An example local service can be that ashared device pre-caches content of another user while a current user isactive, based on their interaction history. For the enterprise service,an enterprise can intelligently understand how their employees interactwith each other and deduce work performance metrics given someinteraction history. Thus, collaboration between employees can betracked and used in performance measurements to determine howcollaboration impacts productivity. Collaboration, such as is indicatedby a pen handoff, can be a more effective method of tracking two or morepeople working together. Other techniques, such as tracking meetingattendance (or other available metrics) can be less effective thantracking a pen handoff. For example, a pen handoff indicates activecollaboration between users, whereas being in a meeting with multiplepeople is a location-based metric and does not necessarily mean that thepeople worked together.

Which third-party sites are chosen can be based on a location of the penhandoff. For example, the processor 810 can determine based on GPScoordinates that the multi-user display 800 is located in a worklocation. As such, the third-party website can be a business networkingsite. On the other hand, if the multi-user display is located in asocial location, such as a restaurant, bar, resort, etc., thethird-party website can be a social networking site. Thus, the processor810 can select one of the multiple third-party sites based on thelocation of the multi-user display.

Changing User Interface View Based on Pen Handoff

FIG. 9 illustrates how the user interface can be modified as a result ofa pen handoff. A top view of the multi-user display 900 in FIG. 9illustrates a user interface 906 before a pen handoff from user A touser B. User A is shown working in an application window 910 which isthe application in-focus prior to a handoff of a pen 912. A view of theuser interface changes when user A hands the pen 912 to user B. Thechange in the user interface 906 can be seen in the bottom view of themulti-user display 900. In particular, the application window 910shifted right on the user interface 906 so as to accommodate space foruser B on the multi-user display. In some embodiments, the applicationwindow 910 can remain in-focus so that user a can continue to input datainto the application. Additionally, a new application window 920 isopened for user B, which can also be in-focus simultaneously withapplication window 910. Thus, as a result of a pen handoff (transferringa user input stylus pen from one person to another), the user interfaceview can be modified. For example, application windows can be shiftedright or left and new application windows can be opened to accommodatethe new active user. Thus, switching the user interface view can meanany of the following: new application windows are opened, applicationwindows are moved, or which applications are in-focus changes.

Other UI changes could also occur. For example, identification data ofthe users can be passed to the application and the application can usethe identification information to obtain stored preferences for theuser. Example preferences can include layout settings, display settings,language preferences, browser settings, desktop settings, etc.

Methods of Interacting with a Multi-User Display Based on Pen Handoff

FIG. 10 is a flow chart of a method of interacting with a multi-userdisplay. In process block 1010 a first user of a stylus pen is detected.By detection, it is meant some level of identification is made todisambiguate one user from another. Such a detection can be accomplishedthrough any of the electronic components described herein, such asfingerprint sensors 560 (FIG. 5), and accelerometer 570, pressuresensors 572, finger position sensors 574, and/or a gyroscope 576. Theadditional camera and voice sensors can also be used in theidentification. Different levels of identification can be used to detectthe first user. For example, knowing past history of an angle at whichthe user writes or a pressure that the user applies while writing can beused as a low-fidelity identification. Higher fidelity identificationcan also be used such as through fingerprint analysis which results in ahigh degree of certainty for identifying the user. Once theidentification of the user is detected, it can be periodically checkedand transmitted to a processor in the multi-user display. In this way,the multi-user display can track users of the stylus pen. One examplemethod of detection can include the operating system reading all of theabove identified sensors from the stylus pen and determining whichsensors include identification information. The operating system canthen apply weights to the different inputs in order to identify the userwith varying levels of degree. For example, a highest weight can begiven to a valid fingerprint, whereas lower weights are given to cameradata.

In process block 1020, a detection can be made that the stylus pen washanded to a second user. Once the second user begins using the pen, theidentification information captured by the stylus pen changes inaccordance with the second user. The stylus pen can then transmit thenew identification information to the processor within the multi-userdisplay. The operating system associated with the multi-user display canthen switch state based on such a detection of a change of the activeuser of the stylus pen. The changing state of the operating systemresults in adapting the functionality associated with the multi-userdisplay in response to the change of the active user. The operatingsystem can maintain a list of users of the stylus pen including whichuser is the active user, the active user being the user that currentlyinputs data into the multi-user display using the stylus pen. The listof users can be stored in a memory accessible by the operating systemsuch as a memory within the processor running the operating system orwithin an external memory.

In process block 1030, functionality of the multi-user display isadapted in response to the change of the active user of the stylus pen.Adapting the functionality means that the user experience associatedwith the multi-user display changes. Adapting the functionality includesany of a variety of different functions that can be changed in themulti-user display. Some examples have been described herein and includeautomatically switching a user interface view of the multi-user displayin response to the change of the active user. Changing the view of theuser interface can include moving application windows or opening newapplication windows. Adapting the functionality can also include openinga user interface window that includes shared content between the firstand second user. The new user interface window can have differentpermissions associated therewith than other open windows on the userinterface. For example, multiple users can be considered logged into thenew interface window, whereas other windows can have permissions foronly a single user. Other adaptations of functionality includeestablishing a relationship automatically between the first and secondusers. Establishing the relationships can include connecting the firstand second users on third-party social networking website orestablishing a network connection between personal devices of the firstand second users. Establishing relationships can further includeestablishing a trust relationship between users, which can impactfunctionality, such as allowing content to pass between the users.Adapting the functionality can further include changing functionality ofan AI system based on the active user. Such adaptation of the artificialintelligence system includes performing voice recognition and treatingcommands from the active user as a different priority (e.g., a higherpriority) than commands from other users. Other adaptations of themulti-user interface can also be made.

FIG. 11 is a flow chart of a method according to another embodiment forinteracting with a multi-user display. In process block 1110, input datais received from a stylus pen identifying a first user. In this example,the stylus pen can wirelessly transmit identification informationobtained in relation to the active user. As previously discussed, theidentification information can be obtained using a variety of hardwarecomponents available on the stylus pen. In process block 1120, inputdata can be received from the stylus pen identifying a second user,different than the first user. Identification of a second user close intime (e.g., less than 1 minute) to receiving identification informationof a first user indicates that a pen handoff occurred. In process block1130, in response to the change of the active user, functionality of themulti-user display can be modified. Modifying the functionality includeschanging the user experience in association with the multi-user display.Such modified functionality includes switching from a single-user modeto a multi-user mode. Other modified functionality can include modifyinga UI view being displayed on the multi-user display. Other adaptationsin functionality have already been described herein.

Computing Systems

FIG. 12 depicts a generalized example of a suitable computing system1200 in which the described innovations may be implemented. Thecomputing system 1200 is not intended to suggest any limitation as toscope of use or functionality, as the innovations may be implemented indiverse general-purpose or special-purpose computing systems. Thecomputing system 1200 can be used as the multi-user display.

With reference to FIG. 12, the computing system 1200 includes one ormore processing units 1210, 1215 and memory 1220, 1225. In FIG. 12, thisbasic configuration 1230 is included within a dashed line. Theprocessing units 1210, 1215 execute computer-executable instructions. Aprocessing unit can be a general-purpose central processing unit (CPU),processor in an application-specific integrated circuit (ASIC), or anyother type of processor. In a multi-processing system, multipleprocessing units execute computer-executable instructions to increaseprocessing power. For example, FIG. 12 shows a central processing unit1210 as well as a graphics processing unit or co-processing unit 1215.The tangible memory 1220, 1225 may be volatile memory (e.g., registers,cache, RAM), non-volatile memory (e.g., ROM, EEPROM, flash memory,etc.), or some combination of the two, accessible by the processingunit(s). The memory 1220, 1225 stores software 1280 implementing one ormore innovations described herein, in the form of computer-executableinstructions suitable for execution by the processing unit(s).

A computing system may have additional features. For example, thecomputing system 1200 includes storage 1240, one or more input devices1250, one or more output devices 1260, and one or more communicationconnections 1270. An interconnection mechanism (not shown) such as abus, controller, or network interconnects the components of thecomputing system 1200. Typically, operating system software (not shown)provides an operating environment for other software executing in thecomputing system 1200, and coordinates activities of the components ofthe computing system 1200.

The tangible storage 1240 may be removable or non-removable, andincludes magnetic disks, magnetic tapes or cassettes, CD-ROMs, DVDs, orany other medium which can be used to store information and which can beaccessed within the computing system 1200. The storage 1240 storesinstructions for the software 1280 implementing one or more innovationsdescribed herein.

The input device(s) 1250 may be a touch input device such as a keyboard,mouse, pen, or trackball, a voice input device, a scanning device, oranother device that provides input to the computing system 1200. In theparticular embodiments described herein, a stylus pen can be used as theinput device. For video encoding, the input device(s) 1250 may be acamera, video card, TV tuner card, or similar device that accepts videoinput in analog or digital form, or a CD-ROM or CD-RW that reads videosamples into the computing system 1200. The output device(s) 1260 may bea display, printer, speaker, CD-writer, or another device that providesoutput from the computing system 1200.

The communication connection(s) 1270 enable communication over acommunication medium to another computing entity. The communicationmedium conveys information such as computer-executable instructions,audio or video input or output, or other data in a modulated datasignal. A modulated data signal is a signal that has one or more of itscharacteristics set or changed in such a manner as to encode informationin the signal. By way of example, and not limitation, communicationmedia can use an electrical, optical, RF, or other carrier.

The innovations can be described in the general context ofcomputer-executable instructions, such as those included in programmodules, being executed in a computing system on a target real orvirtual processor. Generally, program modules include routines,programs, libraries, objects, classes, components, data structures, etc.that perform particular tasks or implement particular abstract datatypes. The functionality of the program modules may be combined or splitbetween program modules as desired in various embodiments.Computer-executable instructions for program modules may be executedwithin a local or distributed computing system.

The terms “system” and “device” are used interchangeably herein. Unlessthe context clearly indicates otherwise, neither term implies anylimitation on a type of computing system or computing device. Ingeneral, a computing system or computing device can be local ordistributed, and can include any combination of special-purpose hardwareand/or general-purpose hardware with software implementing thefunctionality described herein.

For the sake of presentation, the detailed description uses terms like“determine” and “use” to describe computer operations in a computingsystem. These terms are high-level abstractions for operations performedby a computer, and should not be confused with acts performed by a humanbeing. The actual computer operations corresponding to these terms varydepending on implementation.

Although the operations of some of the disclosed methods are describedin a particular, sequential order for convenient presentation, it shouldbe understood that this manner of description encompasses rearrangement,unless a particular ordering is required by specific language set forthbelow. For example, operations described sequentially may in some casesbe rearranged or performed concurrently. Moreover, for the sake ofsimplicity, the attached figures may not show the various ways in whichthe disclosed methods can be used in conjunction with other methods.

Any of the disclosed methods can be implemented as computer-executableinstructions stored on one or more computer-readable storage media(e.g., one or more optical media discs, volatile memory components (suchas DRAM or SRAM), or non-volatile memory components (such as flashmemory or hard drives)) and executed on a computer (e.g., anycommercially available computer, including smart phones or other mobiledevices that include computing hardware). The term computer-readablestorage media does not include communication connections, such assignals and carrier waves. Any of the computer-executable instructionsfor implementing the disclosed techniques as well as any data createdand used during implementation of the disclosed embodiments can bestored on one or more computer-readable storage media. Thecomputer-executable instructions can be part of, for example, adedicated software application or a software application that isaccessed or downloaded via a web browser or other software application(such as a remote computing application). Such software can be executed,for example, on a single local computer (e.g., any suitable commerciallyavailable computer) or in a network environment (e.g., via the Internet,a wide-area network, a local-area network, a client-server network (suchas a cloud computing network), or other such network) using one or morenetwork computers.

For clarity, only certain selected aspects of the software-basedimplementations are described. Other details that are well known in theart are omitted. For example, it should be understood that the disclosedtechnology is not limited to any specific computer language or program.For instance, the disclosed technology can be implemented by softwarewritten in C++, Java, Perl, or any other suitable programming language.Likewise, the disclosed technology is not limited to any particularcomputer or type of hardware. Certain details of suitable computers andhardware are well known and need not be set forth in detail in thisdisclosure.

It should also be well understood that any functionality describedherein can be performed, at least in part, by one or more hardware logiccomponents, instead of software. For example, and without limitation,illustrative types of hardware logic components that can be used includeField-programmable Gate Arrays (FPGAs), Application-specific IntegratedCircuits (ASICs), Program-specific Standard Products (ASSPs),System-on-a-chip systems (SOCs), Complex Programmable Logic Devices(CPLDs), etc.

Furthermore, any of the software-based embodiments (comprising, forexample, computer-executable instructions for causing a computer toperform any of the disclosed methods) can be uploaded, downloaded, orremotely accessed through a suitable communication means. Such suitablecommunication means include, for example, the Internet, the World WideWeb, an intranet, software applications, cable (including fiber opticcable), magnetic communications, electromagnetic communications(including RF, microwave, and infrared communications), electroniccommunications, or other such communication means.

Alternative Embodiments

Other embodiments can be derived from the following numbered paragraphs.

1. A method of interacting with a multi-user display, comprising:

detecting a first user of a stylus pen using the multi-user display;

detecting that the stylus pen was handed to a second user so as tochange an active user of the stylus pen; and

adapting functionality associated with the multi-user display inresponse to the change of the active user of the stylus pen.

2. The method of paragraph 1, wherein the adapting the functionalityincludes automatically switching a user interface view of the multi-userdisplay in response to the change of the active user.

3. The method of paragraph 1 or 2, wherein the user interface window hasa shared context involving the first and second users.

4. The method of paragraph 3, wherein the user interface window sharescontent between the first user and the second user.

5. The method of paragraphs 1-3, wherein the adapting the functionalityincludes establishing a relationship between the first and second user.

6. The method of paragraph 5, wherein the establishing the relationshipincludes automatically connecting the first and second users on athird-party social networking website.

7. The method of paragraph 5, wherein the establishing the relationshipincludes establishing a networking connection or trust relationshipbetween personal devices of the first and second users.

8. The method of paragraphs 1-5, wherein the adapting the functionalityincludes changing functionality of an artificial intelligence systembased on the active user.

9. The method of paragraph 8, wherein the adapting the functionalityincludes performing voice recognition and treating commands from theactive user differently than commands from other users.

10. The method of paragraph 8, wherein adapting the functionalityincludes changing an operating system state in response to the change ofthe active user of the stylus pen.

11. A display system, comprising:

a multi-user interactive display screen;

a processor for receiving input data from the multi-user interactivedisplay screen and from a stylus pen associated with a current activeuser of the stylus pen;

memory coupled to or within the processor;

the processor for performing a method, comprising:

detecting a first user of the stylus pen at a first point in time;

detecting a second user of the stylus pen at a second point in timeindicating that an active user of the stylus pen changed from the firstuser to the second user;

in response to the change of the active user of the stylus pen,modifying the functionality of the display system.

12. The display system of paragraph 11, wherein detecting the first userincludes detecting identification information associated with the firstuser and detecting the second user includes detecting identificationinformation associated with the second user.

13. The display system of paragraphs 11-12, wherein the modifying thefunctionality includes modifying a digital ink color associated with theactive user.

14. The display system of paragraphs 11-13, wherein the modifying thefunctionality includes using profile information associated with theactive user to modify handwriting patterns associated with the activeuser's handwriting so as to make it appear more consistent.

15. The display system of paragraphs 11-14, wherein the modifying thefunctionality includes switching a user interface to display a sharedapplication window, the shared application window including content fromthe first user and from the second user.

In view of the many possible embodiments to which the principles of thedisclosed invention may be applied, it should be recognized that theillustrated embodiments are only preferred examples of the invention andshould not be taken as limiting the scope of the invention. Rather, thescope of the invention is defined by the following claims. We thereforeclaim as our invention all that comes within the scope of these claims.

We claim:
 1. A method of interacting with a multi-user display,comprising: detecting a first user of a stylus pen using the multi-userdisplay; detecting that the stylus pen was handed to a second user so asto change an active user of the stylus pen; and adapting functionalityassociated with an operating system of the multi-user display inresponse to the change of the active user of the stylus pen, wherein theadapting functionality includes at least transitioning the multi-userdisplay from a single-user mode wherein the first user is designated asthe active user to a multi-user mode wherein the second user isdesignated as the active user.
 2. The method of claim 1, wherein theadapting the functionality further includes automatically switching auser interface view of the multi-user display in response to the changeof the active user.
 3. The method of claim 2, wherein the user interfacewindow has a shared context involving the first and second users.
 4. Themethod of claim 3, wherein the user interface window shares contentbetween the first user and the second user.
 5. The method of claim 1,wherein the adapting the functionality further includes establishing arelationship between the first and second user.
 6. The method of claim5, wherein the establishing the relationship includes automaticallyconnecting the first and second users on a third-party social networkingweb site.
 7. The method of claim 5, wherein the establishing therelationship includes establishing a networking connection or trustrelationship between personal devices of the first and second users. 8.The method of claim 1, wherein the adapting the functionality furtherincludes changing functionality of an artificial intelligence systembased on the active user.
 9. The method of claim 8, wherein the adaptingthe functionality further includes performing voice recognition andtreating commands from the active user differently than commands fromother users.
 10. A display system, comprising: a multi-user interactivedisplay screen; a processor for receiving input data from the multi-userinteractive display screen and from a stylus pen associated with acurrent active user of the stylus pen; memory coupled to or within theprocessor; the processor for performing a method, comprising: detectinga first user of the stylus pen at a first point in time; detecting asecond user of the stylus pen at a second point in time indicating thatthe stylus pen has been handed off from the first user to the seconduser so as to change the active user of the stylus pen; in response tothe change of the active user of the stylus pen, modifying thefunctionality of the display system upon which the stylus pen is beingused, wherein modifying functionality includes at least processingtouch-based signals received at the display system based on a first setof parameters when the first user is the active user of the stylus pen,and processing touch-based signals received at the display system basedon a second set of parameters when the second user is the active user ofthe stylus pen, wherein the touch-based signals based on the first andsecond set of parameters are processed by the display system differentlybased on the active user of the stylus pen.
 11. The display system ofclaim 10, wherein detecting the first user includes detectingidentification information associated with the first user and detectingthe second user includes detecting identification information associatedwith the second user.
 12. The display system of claim 10, wherein themodifying the functionality further includes modifying a digital inkcolor associated with the active user.
 13. The display system of claim10, wherein the modifying the functionality further includes usingprofile information associated with the active user to modifyhandwriting patterns associated with the active user's handwriting so asto make it appear more consistent.
 14. The display system of claim 10,wherein the modifying the functionality further includes switching auser interface to display a shared application window, the sharedapplication window including content from the first user and from thesecond user.
 15. The display system of claim 10, wherein the modifyingthe functionality further includes establishing communication channelsbetween mobile devices coupled to the display system.
 16. The displaysystem of claim 10, wherein the modifying the functionality furtherincludes transmitting a request to a third-party social media website toconnect the first and second users.
 17. A storage device for storingcomputer-executable instructions, the computer-executable instructionswhen executed by one or more processors perform a method comprising:receiving input data that a first user is a current active user of astylus pen in association with a multi-user display; receiving inputdata from the stylus pen identifying a change in the active user of thestylus pen to a second user so as to indicate that the stylus pen hasbeen handed off from the first user to the second user; and modifyingfunctionality associated with an operating system of the multi-userdisplay in response to the change of the active user of the stylus pen,wherein modifying functionality includes at least establishingcommunication channels between devices associated with the first andsecond users.
 18. The storage device of claim 17, wherein the modifyingthe functionality further includes changing a user interface on themulti-user display to display shared content from the first and secondusers.
 19. The storage device of claim 17, further includinginstructions for tracking collaboration between the first and secondusers.